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5^;l'FftjaSM^^ T I L 0 
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W?S:*^^'OW^feSi: LT^om^T?. (Xr-yT'S 
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3) o ^-<yhA^W#g?«S5t^^"^>'' 
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yU - 1 ^^P.cD^&a/^y-y FcD§{l^t#0 (X7-'y:/S 
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[0 0 5 5] Sfc, }g^)3^ilLT riliiTO^-^l^F^J tm 
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(57)Abstract: 

PROBLEM TO BE SOLVED: To provide a satisfactory operation environment, 
without giving sense of discomfort to a client, wliile setting plural interspersed 
image pickup possible areas within a range where an image can be picked-up by 
an image pickup direction changeable camera. 

SOLUTION: Multiple image pickup possible areas are set within the range, 
where a pan angle and a tilt angle by one camera are changeable in a camera 
server. Then each virtual camera is assigned to respective each set 
photographing possible area and information, indicating each virtual camera and 
the photographing possible area assigned to it is stored as a camera control 
restricting list. Then it is presented as through the plural cameras are connected 
to the camera server as seen by the client. 
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CLAIMS 



[Claim(s)] 

[Claim 1] It is the image pick-up server which performs distribution service for the 
image information which has an image pick-up means and was acquired by the 
image pick-up means concerned to a client through a network. Two or more 
fields used as the object for service which can be photoed are set up within limits 
which can change the image pick-up direction by said image pick-up means. A 
storage means to memorize the information which specifies two or more 
imagination image pick-up means as the information about two or more set-up 
fields which can be photoed, and each of each field which can be photoed, The 
information corresponding to the imagination image pick-up means by which 
selection directions were carried out is read from said client from said storage 
means. The image pick-up server characterized by having the control means 
which sets up the range of said image pick-up means which can be image 
pick-up direction changed as it is also at the information about said field which is 
shown using the read information concerned, and which can be photoed, and 
controls said image pick-up means within limits which can be concerned image 
pick-up direction changed. 

[Claim 2] An image pick-up server given in the 1st term of a claim characterized 



by memorizing tlie information which shows the identification number of each 
virtual image pick-up means, and the range of the panangle of an image pick-up 
means, and a tilt angle for said storage means to said each of two or more fields 
which can be photoed. 

[Claim 3] An image pick-up server given in the 2nd term of a claim characterized 
by memorizing the information which shows the range which can change further 
the zoom scale factor to said each of two or more fields which can be photoed to 
said storage means. 

[Claim 4] Said control means is an image pick-up server given in the 1st term of 
a claim characterized by including a means to forbid delivery of the image 
information acquired with said image pick-up means while changing the image 
pick-up direction of said image pick-up means, in order to change a virtual image 
pick-up means. 

[Claim 5] The information about said field which can be photoed is an image 
pick-up server given in the 1st term of a claim characterized by being stored in a 
server. 

[Claim 6] An advice means of selection to notify the information which is the 
client connected to an image pick-up server given in the 1st term of a claim, 
chooses one of the virtual image pick-up means memorized by said storage 
means, and specifies the selected virtual image pick-up means to said image 



pick-up server, The client characterized by having a display means to display the 
image delivered from said image pick-up server, and an image pick-up direction 
modification directions means to change the image pick-up; direction of the 
image pick-up means chosen with said advice means of selection, and to direct 
the modification result concerned to said server. 

[Claim 7] The information about said field which can be photoed is a client given 
in the 6th term of a claim characterized by downloading from said image pick-up 
server. 

[Claim 8] It is the image pick-up system which consists of clients which receive 
the image information from the image pick-up server which performs distribution 
service for the image information which has an image pick-up means and was 
acquired by the image pick-up means concerned through a network, and the 
image pick-up server concerned. Said image pick-up server sets up two or more 
fields used as the object for service which can be photoed within limits which can 
change the image pick-up direction by said image pick-up means. A storage 
means to memorize the information which specifies two or more imagination 
image pick-up means as the information about two or more set-up fields which 
can be photoed, and each of each field which can be photoed, The information 
corresponding to the imagination image pick-up means by which selection 
directions were carried out is read from said client from said storage means. The 
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range of said image pick-up means which can be image pick-up direction 
changed is set up as it is also at the information about said field which is shown 
using the read information concerned and which can be photoed. It has the 
control means which controls said image pick-up means within limits which can 
be concerned image pick-up direction changed. Said client An advice means of 
selection to choose one of the virtual image pick-up means memorized by said 
storage means, and to notify the information which specifies the selected virtual 
image pick-up means to said image pick-up server, The image pick-up means 
system characterized by having a display means to display the image delivered 
from said image pick-up server, and an image pick-up direction modification 
directions means to change the image pick-up direction of the image pick-up 
means chosen with said advice means of selection, and to direct the 
modification result concerned to said server. 

[Claim 9] It is the control approach of the image pick-up server which performs 
distribution service for the image information which has an image pick-up means 
and was acquired by the image pick-up means concerned to a client through a 
network. Two or more fields used as the object for service which can be photoed 
are set up within limits which can change the image pick-up direction by said 
image pick-up means. The storing process which stores the information which 
specifies two or more imagination image pick-up means as the information about 



two or more set-up fields which can be photoed, and each of each field which 
can be photoed in a predetermined storage means, The information 
corresponding to the imagination image pick-up means by which selection 
directions were carried out is read from said client from said storage means. The 
control approach of the image pick-up means server characterized by having the 
control process which sets up the range of said image pick-up means which can 
be image pick-up direction changed as it is also at the information about said 
field which is shown using the read information concerned, and which can be 
photoed, and controls said image pick-up means within limits which can be 
concerned image pick-up direction changed. 

[Claim 10] It is the storage which stored the program code on which a computer 
functions considering the image information which has an image pick-up means 
and was acquired by the image pick-up means concerned by reading and 
performing as an image pick-up server which performs distribution service to a 
client through a network. Two or more fields used as the object for service which 
can be photoed are set up within limits which can change the image pick-up 
direction by said image pick-up means. A storage means to memorize the 
information which specifies two or more imagination image pick-up means as the 
information about two or more set-up fields which can be photoed, and each of 
each field which can be photoed, The information corresponding to the 



imagination image pick-up means by which selection directions were carried out 
is read from said client from said storage means. The storage which stored the 
program code which functions as a control means which sets up the range of 
said image pick-up means which can be image pick-up direction changed as it is 
also at the information about said field which is shown using the read information 
concerned, and which can be photoed, and controls said image pick-up means 
within limits which can be concerned image pick-up direction changed. <BR> 



DETAILED DESCRIPTION 

[Detailed Description of the Invention] 
[0001] 

[Field of the Invention] This invention relates to the image pick-up server, the 
client, the control approach, system, and storage which deliver the image 
information picturized and acquired with the image pick-up means on networks, 
such as the Internet. 
[0002] 

[Description of the Prior Art] There is a system which can observe the image of 
the video camera which is one of the image pick-up means from the many points 



of a remote place. And the applicant for this patent prepared the server (camera 
server) which picturizes a camera, and the client linked to the server on the 
general-purpose network, and proposed some techniques which it not only 
observes the camera image of a camera server, but enable remote operation of 
whenever [ pantilt angle / of the camera ], a zoom scale factor, etc. by the client 
side. 

[0003] The general-purpose network in this case is the network typical Internet 
which used for example, the TCP/IP protocol. And it connected with the personal 
computer (following, only PC) at it, and the configuration of the above-mentioned 
server connected the camera in which computer control is possible, and was 
realized by carrying the program used as a camera server on it. Moreover, in a 
client, a WWW (World WideWeb) browser makes it operate and the angle type 
of a camera server is operated through a graphical user interface. However, it is 
only one client that the camera of a camera server can be operated by remote 
control, and a camera server delivers the same image picturized to two or more 
connected clients. 
[0004] 

[Problem(s) to be Solved by the Invention] In such a system, it may be 
necessary to prepare the range which may be picturized, and the range which is 
not so. A reason is because it leads to problems, such as privacy, when 



whenever [ pantilt angle ], and a zoom scale factor are operated by remote 
control and the zoom scale factor in a certain specific include angle (direction) 
has been made very high. 

[0005] even narrowing rather than the movable range of a physical camera for 
such privacy protection - a camera -- it is required to prepare a limit in the 
operational range. This operational range (a camera is not the range which can 
be changed potentially) was that to which sets up an upper limit and a minimum 
to whenever [ pantilt angle ], or a zoom scale factor, and a range limit is applied 
simply. 

[0006] That is, it is theta (it considers as what has a large value, so that a pan is 
carried out to the right) about a paninclude angle. 

Whenever [ tilt angle / phi ] (it considers as what has a large value, so that a pan 
is turned up) 

Zoom scale factor z (it considers as what has a large value, so that a scale factor 
is large) 

When carried out, the operational range was set, for example as one field as 
follows. 

theta min<=theta<=theta max (a thetamin:pan include-angle left end, thetamax: 
paninclude-angle right end) 

phi min<=phi<=phi max (phimin: whenever [ tilt angle ] a minimum, phimax: 



paninclude-angle upper limit) 

zmin<=z<=zmax (a Zmin:zoom scale-factor minimum, zmax: zoom scale-factor 
upper limit) 

however - although it may exist [ actually, discretely / the range (field) which 
may be picturized or the range which is not picturized /, i.e.. at intervals, and ] 
and the upper limit of a zoom scale factor may be high in the specific range - 
other than this coming out the upper limit of a zoom scale factor cannot meet 
the want of wanting to stop low. 

[0007] Moreover, usually in such a system, the manager who sets up the 
operational range in a camera server differs from the operator (camera user) of a 
client side who operates a camera. Therefore, if a manager sets up a 
complicated operating range and it will be made the operator of a client, there is 
also a problem of in which range (field) a zoom scale factor and the visible range 
being restricted how and becoming incomprehensible intuitively. 
[0008] Furthermore, to be able to set up the operational range flexibly more 
intelligibly also for a manager was desired. 
[0009] 

[Means for Solving the Problem] This invention is made in view of this trouble, 
though two or more fields with which it is dotted within limits which can be 
picturized as it is also with an image pick-up means by which the image pick-up 



direction can be changed and which can be picturized are set up, does not tend 
to give any sense of incongruity to a client, but tends to offer the image pick-up 
server which can offer a good operating environment, a client, the control 
approach, a system, and a storage. 

[0010] In order to solve this technical problem, the image pick-up server of this 
invention is equipped with the following configurations. Namely, it is the image 
pick-up server which performs distribution service for the image information 
which has an image pick-up means and was acquired by the image pick-up 
means concerned to a client through a network. Two or more fields used as the 
object for service which can be photoed are set up within limits which can 
change the image pick-up direction by said image pick-up means. A storage 
means to memorize the information which specifies two or more imagination 
image pick-up means as the information about two or more set-up fields which 
can be photoed, and each of each field which can be photoed, The information 
corresponding to the imagination image pick-up means by which selection 
directions were carried out is read from said client from said storage means. The 
range of said image pick-up means which can be image pick-up direction 
changed is set up as it is also at the information about said field which is shown 
using the read information concerned and which can be photoed, and it has the 
control means which controls said image pick-up means within limits which can 



be concerned image pick-up direction changed. 
[0011] 

[Embodinnent of the Invention] Hereafter, the operation gestalt which starts this 
invention according to an accompanying drawing is explained to a detail. 
[0012] When the outline of this operation gestalt was explained briefly and one 
camera connected to the camera server is seen from a client side, it shows as if 
they were two or more cameras. 

[0013] Drawing 1 is the block block diagram of the system in this example. 
[0014] While 1-1 displays camera server equipment (only henceforth a camera 
server) among drawing and 1-2 displays the image from the camera server 1-1, 
it is the display operating station (henceforth a client) which operates a camera 
by remote control, and these are connected by the network 1-3. 
[0015] Now, the camera server 1-1 receives the camera-control command from 
a client 1-2, and controls the zoom scale factor and the movable universal head 
1-12 of a video camera 1-11 while it incorporates the image from a video camera 
-1-11 and performs delivery to client equipment 1-2 (a panangle and a tilt angle 
can be changed in operating the movable universal head 1-12). 
[0016] In addition, although it shows the camera server 1-1 and one client 1-2 at 
a time in the graphic display, a limit does not have them in this number. It is for 
giving explanation an easy thing. A camera server and a client also explain the 



following explanation as that whose number is one, respectively. Moreover, the 
class will not be asked if it is digital networks with sufficient band to let the 
camera-control signal described later and the compressed video signal pass 
also about a network 1-3, such as the Internet and intranet. 
[0017] However, when you assume a TCP/IP (UDP/IP) protocol as a network 
protocol in an operation gestalt and you call it the address below, suppose that 
an IP address is pointed out. moreover, the camera server 1-1 and a client 1-2 - 
both IP addresses shall be assigned 

[0018] Although the camera server 101 can be constituted from a personal 
computer The zoom scale factor of movable universal-head equipment 1-12, 
and a video camera 1-11 and movable universal-head equipment 1-12 which 
controls whenever [ pantilt angle / of the universal head of a video camera 1-11 
and a video camera ] like a graphic display, Whenever [ pantilt angle ] The 
camera and the universal-head control section 1-13 to control, the image input 
section 1-15 which incorporates the image from a video camera 1-11, the 
incorporated image compression zone 1-16 which carries out an image data 
compression, the communications control section 1-14 which delivers 
compressed image data on a network, The command from the client 1-2 in one 
to network 3 course is interpreted, and it consists of storage 1-18 used for the 
data delivery of command interpretation / activation section 1-17 and each part 



which controls each part of camera server equipment. 

[0019] In addition, the image input section 1-15 incorporates the NTSC video 
signal from a video camera 1-11, compresses it by MotionJEPG after A/D 
conversion, and is passed to the communications control section 1-14. Although 
considered as MotionJEPG compression as a compressed format of an image 
here, not only this but of course, what kind of compressed format is sufficient. 
[0020] Next, the camera client 1-2 is described. 

[0021] Like [ this client ] a server, it can constitute from general-purpose 
information processors, such as a personal computer, and it is received through 
the communications control section 1-21, and is elongated in the image 
expanding section 1-25, and the compression image data delivered from the 
camera server 1-1 are displayed in the graphic display section 1-26. Moreover, it 
has come to be able to perform camera control, image storage preservation 
actuation, etc. by actuation of the user interface on camera client equipment. 
The display and control section 1-24 is performing control of these screen 
display and actuation. 

[0022] The bit mapped display is contained in the graphic display section 1-21, 
and a screen (user interface) like drawing 2 can be constituted. The window 
system was used as the graphic display section 1-21 in an operation gestalt. As 
this system, there is Windows 95 of U.S. Microsoft Corp. or X-Window of UNIX. 



[0023] In drawing 2 , the graphic display field where, as for 2-1, an image is 
displayed, and 2-2 are the camera control panels for camera actuation, and this 
is displayed in a window format. 2-22 in the camera control panel 2-2, 2-23, and 
2-28 are scroll bars, and can operate a zoom scale factor now whenever 
[ paninclude-angle / of a camera /, and tilt angle ], respectively, A scroll bar 2-21 
is an object for panangle actuation, and it is used in order to publish the 
assignment command of the panangle over a camera server by moving the knob 
of the rectangle currently displayed into the bar to right and left with pointing 
devices, such as a mouse, (it being called drag actuation generally). In addition, 
the display position of a "knob" shows the current location in the actuation limit 
field of a panangle. It is an object for tilt angle actuation, a scroll bar 2-28 is an 
object for zoom scale-factor actuation, and the semantics of the location of 
operation information and each knob of a scroll bar 2-23 is the same as that of 
the scroll bar 2-21 for panangles. 

[0024] However, since the user of two or more clients can regard the image from 
the same camera of the same camera server as having explained previously, it 
is only one client to have the place of a join office and a right of actuation. 
Therefore, at other clients, a scroll bar 2-21, 2-23, and 2-28 are displayed with a 
gestalt as shows that it is actuation disabling (for example, it displays thinly). 
Moreover, although it is the method of acquisition of the right of actuation, the 



actuation initiation carbon button 2-21 of a grapfiic display is performed by 
directing with a mouse etc. Directions of this carbon button publish the right 
acquisition demand of actuation to the camera server of a connection place. If 
other clients which have already published the right of actuation exist this 
demand at the time of a carrier beam, a camera server publishes improper 
advice to a demand, and if it does not exist, it will publish the right of actuation. 
However, a camera server publishes advice which makes the right of actuation 
an invalid, when the time amount which has granted the right of actuation to one 
client is clocked and predetermined time progress is carried out. 
[0025] Explanation is returned to the user interface of drawing 2 . Among 
drawing, 2-30 is a camera change carbon button, and if this carbon button is 
pushed, a pull down menu like 2-31 will be displayed. In addition, in the case of a 
pull down menu 2-31, three kinds of cameras of a camera 1 - a camera 3 can be 
chosen now. not a camera (the number of cameras physical to the camera 
server in an operation gestalt is one) with this actual camera name but "the 
imagination camera" which states below - corresponding ~ **** ~ camera 
selection here ~ corresponding "an imagination camera" ~ changing 
(selection) - it carries out. Moreover, the virtual camera name under selection 
shall be displayed on a carbon button 2-30. Furthermore, the list information on 
this "imagination camera" that can be chosen is transmitted from a server, when 



that client connects with a cannera server. 
[0026] "An imagination camera" is explained using drawing 9 . 
[0027] the range in all the pantilt range that the camera 1-11 of the camera 
server 1-1 can boil a frame 9-3 actually, and can be photoed which can be 
picturized is shown (however, a zoom scale factor is the range in the minimum 
scale factor). And the field where the field shown with a slash permits an image 
pick-up is shown. If it puts in another way, fields other than a slash show the field 
which must not be picturized on problems, such as privacy. 
[0028] Since the panangle and a tilt angle can be changed, the camera 1-11 of 
thinking that one camera can change the angle type in the rectangle range will 
be natural if it is made into the user of a client. If it puts in another way and one 
camera will enable it to picturize in an inverted-L character field and the 
dispersed field like a graphic display, sense of incongruity will be given. Then, in 
order to make it not give this sense of incongruity, with the operation gestalt, the 
field which can be picturized was divided into some rectangle fields, and the 
imagination camera was assigned to each division field (12 a graphic display 9 
-11,9- nine three of -13). Consequently, if it is made a user, since it is visible as 
if the camera (imagination camera) of plurality (a graphic display three) was 
connected to the camera server 1-1, and each camera seems to be able to 
change that angle type freely by rectangle within the limits, it can avoid giving 



any sense of incongruity. The camera name displayed with the pull down menu 
2-31 of drawing 2 shows this very imagination camera, 

[0029] Here, it is theta (it considers as what has a large value, so that a pan is 
carried out to the right) about a paninclude angle. 

Whenever [ tilt angle / phi ] (it considers as what has a large value, so that a pan 
is turned up) 

Zoom scale factor z (it considers as what has a large value, so that a scale factor 
is large) 

If it carries out, the operational range of a certain specific virtual camera can be 
set up as follows, for example. 

[0030] theta min<=theta<=theta max (a thetamin:pan include-angle left end, 
thetamax: paninclude-angle right end) 

phi min<=phi<=phi max (phimin: whenever [ tilt angle ] a minimum, phimax: 
paninclude-angle upper limit) 

zmin<=z<=zmax (a Zmin:zoom scale-factor minimum, zmax: zoom scale-factor 
upper limit) 

For example, when it applies to the rectangle field 9-11 in drawing 9 , the 
imagination pantilt operating range of a camera corresponding to this field 
serves as (thetamin, phimin), and (thetamax, phimax) in that pair vectorial angle. 
[0031] Of course, (thetamin, phimin), and (thetamax, phimax) have fallen within 



the actuation range of the physical whole. In addition, with an operation gestalt, 
although the number of virtual cameras is set to three, it can crawl on it not only 
in this but logically, and it can also set up shoes. Moreover, the field which 
shows the operating range of a virtual camera may lap mutually. In addition, the 
ID number for virtual camera discernment shall be shaken at all imagination 
cameras. Internally, the camera operating-range table as shown in drawing 10 
shall hold to the shared memory 3-43. Moreover, the physical camera connected 
to one camera server may be not only one but two, or more than it. In this case, 
the table shown in one a physical camera and physical drawing 10 is made to 
correspond. That is, the table shown in drawing 10 should prepare only the 
number of physical cameras. 

[0032] Drawing 3 is the process block diagram of this example. A process means 
the thing in multitasking operating systems, such as WindowsNT and UNIX, here. 
In the steady state, all these processes 3-11, 3-12, 3-21, 3-22, and 3-31 shall 
work. 

[0033] Each process which is on the camera server 1-1, and operates is as 
follows. 

- Camera-control server process 3-11 : perform control which outputs an 
instruction for the camera-control instruction which the client process 3-31 which 
has a right of actuation published to reception and the camera-control section 



1-13. 

- Advice process 3-12 of a camera condition : detect conditions, such as 
whenever [ pantilt angle / of a cannera ], and notify to the client process 3-31. 

- - image acquisition / transmitting process 3-22 of managing the transmission 
place of an image server process 3-21:camera image : perform incorporation 
and transmission of a camera image. 

[0034] In addition, the graphic display prohibition flag 3-41, the transmission 
place list 3-42, the camera-control range limit list 3-43, and the camera status 
register 3-44 are formed in the shared memory used for delivery of data between 
processes. Moreover, the camera-control limit range register 3-45, the right flag 
3-51 of a limit, and the camera list of number 3-52 are the registers for saving the 
data of a process temporarily. 

[0035] The detail of actuation of the process 3-11 to 3-22 on the camera server 
1-1 is shown in flow chart drawing 4 , and 5 and 6, on the camera client 1-2, the 
client process 3-31 is operating and the detail of the actuation is shown in 
drawing 7 . In addition, the program corresponding to these flow charts is 
memorized by the stores (for example, hard disk drive unit etc.) which a server 
or each client has, and it will be loaded to main storage (Maine RAM), and will be 
performed. 

[0036] First, each process of a camera server is explained using the flow chart of 



drawing 4 -7. 

[0037] In addition, tine thing of a format like drawing 8 as a packet will be 
generated, and it will be transmitted to a network 1-3 (although the format used 
by packets, such as TCP/IP and UDP/IP, will be used strictly, drawing 8 
described only packet information required for explanation of an example). 
[0038] First, a camera-control process and the advice process of a camera 
condition are explained using the flow of drawing 4 . 

[0039] If the camera-control server process 3-11 is started (step S400), the 
advice process 3-12 of a camera condition will be generated (step S402), and it 
will wait for the camera-control connection request ( drawing 8 (1)) from the 
client process 3-31 (step S403). The camera-control command transmitted from 
the client process 3-31 which performed connection reception processing (Ack is 
returned) (step S404), and had connection when there was a connection request 
from the client process 3-31 ( drawing 8 (2) it waits for - (4) (step S405).) In 
addition, in connection reception processing, as explained previously, the list 
information on the imagination camera which a camera server has is notified to a 
client, and is got blocked and transmitted to it. moreover, at this time, if a timer 
set is carried out and a certain fixed time amount (it is called "control **** time 
amount") passes, camera-control connection will be cut ~ it is like (step S407). 
[0040] Reception of a camera-control command ( drawing 8 (2) - (4)) controls 



whenever [ zoom scale-factor / of a video camera 1-11 /, and pantilt angle / of 
movable universal-head equipment 1-12 ] through the camera-control section 
1-13 according to the command (step S409). A camera-control command is 
received from the client process 3-31, and camera control according to a 
command is performed through the command interpretation section 1-17 and the 
camera universal-head control section 1-132 until control **** time amount 
finishes. In addition, the detail of the processing according to control command 
was shown in drawing 5 . As a camera-control command, in order to simplify 
explanation, it shall be either of the next instructions here. 
[0041] 

Paninclude-angle variation order PAN It is a variation order whenever [ theta tilt 
angle ]. TIL phi zoom scale-factor variation order ZOM alpha, however theta, phi 
and alpha are the parameters showing a zoom scale factor whenever 
[ paninclude-angle and tilt angle ], respectively, and, otherwise, the various **** 
****, such as backlight amendment, and auto-focusing, manual focus value 
setting out, omit explanation to this camera-control command here. 
[0042] Furthermore, there is also the next instruction for an "imagination camera" 
change ( drawing 8 (5)). 

Camera change instruction SEL n (however, n shows the identification number 
of a virtual camera) 



At the time of a camera change demand instruction, the operating range 
corresponding to a virtual camera identification number is read from the 
camera-control range limit list 3-43, it sets it as a camera-control limit range 
register and the camera status register 3-44 (step S502), and the value of the 
pantilt zoom calculated in the following procedure is initialized as an initial 
position of an imagination camera (step S504). The initial value of an 
imagination camera considers as the value of the center of the limit range about 
whenever [ pantilt angle ], and is taken as the value of the minimum scale factor 
of the limit range about a zoom scale factor. However, the pantilt zoom of the 
limit range may be defined beforehand and what is set to the value is sufficient. 
[0043] In addition, since it may pass through the field which does not permit 
image transmission during a virtual camera change (i.e., under camera pan tilt 
zoom modification), the image in the meantime sets the graphic display 
prohibition flag to ON so that it may not transmit (steps S503 and S505). When 
this image pinching prohibition flag is in ON condition, the information on "-1" is 
notified to each client that it mentions later as an identification number of a virtual 
camera. When it carries out like this and the directed virtual camera changes into 
the condition (a panangle, a tilt angle, zoom scale factor) of having set up at step 
502, a graphic display prohibition flag is set as OFF. This can perform delivery 
processing of an image now again. 



[0044] On the other hand, in a pan, a tilt, and a zoom demand instruction, when it 
confirms whether a zoom scale factor is the virtual camera actuation-within the 
limits whenever [ paninclude-angle / which is contained in an instruction / and tilt 
angle ] (steps S511 and S521) and the value has exceeded the range, it resets 
to the upper limit (when a value is too large) of an operating range thru/or the 
value of a minimum (when a value is too small), and camera control is performed. 
[0045] After fixed time amount passes since camera-control connection initiation 
and control **** time amount is completed, connection cutting processing (S407) 
is performed and a camera-control connection termination instruction ( drawing 8 
(8)), i.e., the instruction deprived of the right of actuation of a camera, is returned 
to the client process 3-31 in processing of this step S407. And it waits for a 
connection request to come again (S403). Although the camera-control server 
process 3-1 1 receives the camera-control connection request from the client 
process of the arbitration carried out similarly and camera actuation is realized, it 
is not simultaneously connectable with two or more client processes so that 
drawing 4 may also show. Therefore, connection-oriented connection [ like 
TCP/IP ] whose the connection of this is shall be made. 

[0046] While the advice process 3-12 of a camera condition generated at step 
S402 operates, a camera condition is always checked. It reads by asking a 
camera and the universal-head control section 1-13. whenever [ namely, / pantilt 



angle / of a camera ] - a zoom scale factor (= p, t, z) -- carrying out -- While 
writing in the camera status register 3-44 (step S422) See the condition of the 
graphic display prohibition flag 3-41 (step S423), and a camera condition will be 
made into "under a camera change" (virtual camera identification number n=-1) 
if a flag is ON (step S424). A camera condition (format of drawing 8 (9)) is 
notified to the client process 1-2 which has transmitted the image (step S426). 
[0047] Next, an image server process and image acquisition / transmitting 
process are explained using the flow of drawing 6 . 

[0048] If the image server process 3-21 is started (step S600), image acquisition 
/ transmitting process 3-22 will be generated (step S602), and it will wait for the 
event from the client process 3-31 (step S603). Here, if an event is a graphic 
display initiation demand command ( drawing 8 (7)) (step S604), the transmitting 
agency address of the packet contained in the graphic display demand packet 
will be checked, and it will add to the transmission place list 3-42 of images. If it 
is a graphic display termination demand command (step S606), the transmitting 
agency address of the packet similarly contained in the graphic display demand 
packet will be checked, and it will delete from the transmission place list 3-42 of 
images. In addition, the address of an image transmission place is held by list 
form at the image transmission place list 3-42. 

[0049] If image acquisition / transmitting process 3-22 is started, it will repeat the 



next actuation. That is, it conripresses by incorporating as a frame of a cannera 
image (step S622) (step S623), and if a graphic display prohibition flag is not ON 
(step S624), this compressed image data will be packet-ized in the format of 
drawing 8 (10), and it will transmit to two or more addresses in the image 
transmission place list 3-42 (step S625). 

[0050] Next, the client process 3-31 which operates by the client side is 
explained according to the flow chart of drawing 7 . 

[0051] First, initialization processing is performed at the time of process starting 
(step S701), and a graphic display initiation demand is transmitted to the camera 
server corresponding to the address (it considers as "ADDR_C" an IP address 
and here) of the camera server equipment 1-1 to connect (step S702). The 
packet format at this time is the passage of (6) of drawing 8 . 
[0052] If Ack does not come on the contrary from the camera server 
corresponding to ADDR_C here (step S703), since it is the abnormalities in 
actuation - the address is wrong ~ a client process is ended (step S704). 
[0053] Moreover, since it will be a display success if Ack comes on the contrary 
(step S703), it waits for reception of an event, i.e., the input by a user's user 
interface, or the various packets from the camera server 1-1 (step S705). 
[0054] Here, he checks whether it is the condition which has already started 
camera control with the right flag 3-51 (variable secured to RAM which a client 



has) of actuation (step S707), and if a user pushes the actuation initiation carbon 
button 2-21 (step S706), if it is [ be / it ] already under control, it will return to step 
S605. If it is not [ be / it ] under actuation, a cannera-control connection request 
( drawing 8 (1)) will be published to a camera-control server process (step S708), 
and it will wait for authorization (Ack) (step S709). If Ack comes on the contrary 
here, connection will be materialized to a camera-control server process, the 
right flag 3-51 of actuation in the storage section 1-29 of client equipment will be 
set (step S711), and actuation of the camera control panel 2-2 (the image 
pick-up direction modification carbon button and scroll bar) will be confirmed. In 
addition, a camera-control server process receives a connection request only at 
the time of the waiting step S403 for a camera-control connection request. 
[0055] Moreover, after carrying out connection formation and completing the 
"control latency time", a camera-control connection termination demand 
( drawing 8 (8)) comes on the contrary from a camera-control server process, but 
if this is received (step S714), the right flag 3-51 of actuation will be cleared (step 
S715), and actuation of the camera control panel 2-2 will be made into an invalid 
(step S716). 

[0056] While actuation of the camera control panel 2-2 is effective, the 
camera-control instruction corresponding to actuation of the camera control 
panel 2-2 is generated, and it is published by the camera server process 1-2 



(steps S717-S718). In addition, when a camera is chosen from the camera 
change pull down menu 2-31 of the camera control panel 2-2, an instruction 
( drawing 8 (5)) of a camera change is published (steps S719-S720). In addition, 
it omits about the generation process of an instruction here. 
[0057] To the client process termination demand (step S726) published by 
actuation of a menu etc., a graphic display termination demand ( drawing 8 (8)) 
is published (step S728), and a client process is ended (step S628). 
[0058] When a packet arrives and (step S721) and it are image data ( drawing 8 
(10)) (step S722), after reading the compression image data in image data and 
performing expanding processing, the display image of the graphic display panel 
of 2-1 is updated using this image frame data (step S723). 
[0059] When an arrival packet is advice of a camera condition ( drawing 8 (9)), 
the display position of the notch (knob part) of the scroll bar 2-21 which operates 
whenever [ (step S724) and pantilt angle ], and a zoom scale factor, 2-23, and 
2-28 is changed into a corresponding location using the parameter contained in 
the packet. Moreover, the camera name corresponding to a virtual camera 
identification number is displayed on the camera change pulldown carbon button 
of 2-30. (This will have updated the information, when other client processes are 
operating the camera by remote control) . In addition, matching of a virtual 
camera identification number and a camera name uses what response relation 



was notified to from the advice process 3-12 of a camera condition, however, the 
time (it is the case where a camera is moving to the range which can photo a 
virtual camera) of a virtual camera identification number being -1 a virtual 
camera change - it supposes that it is working and is camera changing to the 
graphic display panel 2-1 - it indicates by the purport. 

[0060] According to the operation gestalt the above result, one physical camera 
which a camera server has if it saw from a client, as if it would be two or more 
cameras (imagination camera) - visible ~ each virtual camera moreover - at 
least, since a panangle and a tilt angle can be freely changed if they are 
rectangle within the limits It can even be managed with the problem of privacy 
there at not knowing that there is a field where the image pick-up is restricted, 
and it can avoid also giving any sense of incongruity moreover. 
[0061] In addition, it explained in advance and it is also possible to form two or 
more cameras for a physical camera in one camera server. What is necessary is 
just to set two or more virtual cameras as each of each physics-camera also in 
this case. At this time, a camera server grants the right of actuation 
independently to a client about the physical camera to write. 
[0062] Moreover, what is necessary is in the case of the manager of a camera 
server, to carry out the direct control of the camera server, to edit a 
camera-control limit list, but to connect like a client, to notify to a camera server 



that he is a manager there (for example, for ID, a password, etc. to notify), and 
just to transmit the file of a limit list to a camera server with protocols, such as ftp. 
[0063] Or when it is a manager, the range frame which a physical camera has 
and which can change a panangle and a tilt angle is displayed on a screen, and 
you may make it set the movable panangle of a virtual camera and its virtual 
camera, and a tilt angle as each rectangle field by setting up many rectangles as 
it is also with pointing devices, such as a mouse, in it. Lessons is taken for a 
zoom scale factor from each rectangle field set up, for example, and it should 
just set up a upper limit and a lower limit with a keyboard, a mouse, etc. Of 
course, what is necessary is just to only operate the program for providing a 
manager with the above-mentioned actuation, when for that a manager logs in to 
a camera server side. 

[0064] Next, the situation that camera server equipment with two or more 
controlled restriction fields (two or more virtual cameras) and the camera server 
equipment which has not set up restricting especially are intermingled, and is 
connected to the network, respectively is explained using drawing 11 . 
[0065] In the situation that two or more camera servers exist, to show the user 
using a camera client the list of camera servers (displaying a list like drawing 12 ), 
and to enable it to choose from the inside the camera server which he wants to 
see with pointing devices, such as a mouse, is desired. 



[0066] If a camera server is chosen by the user, a camera client will transmit a 
graphic display initiation demand, as it is in step S702 of drawing 7 . If this 
invention is used, two or more controlled restriction fields can be treated as a 
separate independent camera like other camera server equipments. For 
example, in the user interface of drawing 1 1 , each controlled restriction field of a 
camera server with same camera 1 - camera 3 corresponds. A camera 4 and a 
camera 5 are respectively different camera servers. 

[0067] this example -- like 1 camera server equipment two or more 
camera-control limit range - that is a means to manage the field (for it to be 
called a "controlled restriction field") which restricted the range of whenever 
[ pantilt angle ], and a zoom scale factor -- preparing - 2 each limit field A 
control range limit is performed by setting up a panleft end include angle, a 
panright end include angle, a tilt minimum include angle, a panupper limit include 
angle, a zoom minimum scale factor, and a zoom upper limit scale factor. From 3 
client process Each controlled restriction field is shown as if it was the separate 
independent imagination camera, respectively. From 4 client process When 
changing two or more controlled restriction fields, a more realistic and flexible 
camera-control limit entry is made possible to the problem of privacy by what is 
treated as if it was two or more camera changes. That is, each camera-control 
range limit field is simple setting out, and it is a concept of two or more 



imagination cameras, and since piuraiity can set up such a ccntroiied restriction 
range field and those who set up the camera-control range are seen also from a 
client process as a separate camera with which controlled restriction range 
differs that what is necessaiy is iust to set up the controlled restriction range as a 
different camera, it becomes easy to do grasp of the limit range. 
,0068] in addition, with the above-mentioned operation gestalt, the base of what 
needs hardware called the means for connecting with a camera server in an 
image pick-up means and a networi. is realizable with general-purpose 
information processors, such as a personal computer, moreover - a client does 
no, only have an image pick-up means - it Is - fundamental hardware - a 

,»r the same - it can build with general-purpose information 

camera server - tne same u 

processors, such as a personal computer. 

(0069, What IS necessa^ will be just to have the program which the hardware to 
need is utilized 1 program , in short and operates eguipment as a camera server 
or a Client. Therefore, the invention in this application is attained also by 

realizes the function of the operation gestai. mentioned above to a system or 
equipment, and carrying out read-out activation of the program code with which 
,he computer (or CPU and MPU) of the system or ecuipment was stored in the 



Storage. 



,0070, .n «s case, the function of .he operation gesfaU which me program code 
i.e,f read fron, ,he storage mentioned above w„i be realized, and the storage 
which memorized that program code wii, constitute this invention. 

,0071, AS a storage for supplying a program code, a floppy disK, a hard disk, an 
optical disK, a magneto-optic disK, CD-ROM, CD-R, a magnetic tape, the 
memory card of a non-volatiie, ROM, etc. can be used, for example. 
,0072, Moreover, it cannot be overemphasized that it is contained also when the 
unction Of the operation gestait which performed a part or ail of processing that 
OS (operating system, which is working on a computer is actual, based on 

mentioned above by performing the program code which the computer read is 
no. only realized, but was mentioned above by the processing is realized. 
,0073, Furthermore, after the program code read from a storage is written in the 
memory with which the functional expansion unit connected to the functiona, 
add-,n board inserted in the computer or a computer is egulpped, it cannot be 

,es.alt Which performed a part or a„ of processing that the CPU with which the 
..nctiona, add-in board and functional expansion unit are equipped based on 
erections of the program code is actual, and mentioned above by the processing 

is realized. 



,0074, Moreover, although .he camera was mentioned as .he example as an 

limited to this. 
[0075] 

,E„ec. o, .he ,nven.ion, hecones possible ho. .o give any sense of inoongruiW 
,0 a ciien., bu. .o o«er a good opera.ing environment .hough ^«o or .ore .eids 

set up. 



DESCRIPTION OF DRAWINGS 



[Brief Description of the Drawings] 
^^^^^^j^ It is the block block diagram 



of the camera system in an operation 



gestalt. 



^^^^^^^^r^Qjl It is drawing showing the user 
operation gestalt. 



interface of the client side in an 



^DrawingL31 It is drawing showing 



the operating sequence in the system in an 



operation gestalt. 

,t ,s .he flow Char, which shows actuation of the camera sewer in an 

operation gestalt. 

,5^^ U is the flow char, which shews actuation of .he camera server in an 

operation gestalt. 

^^^^ U is .he flow cha. which shows actuation of the can^era se.er in an 

operation gestalt. 

^g^Uistheflowchartwhich shows actuation Che Cientin an operation 

gestalt. 

jp^^ is drawing showing a format o, each command in an operation 

gestalt. 

^^^^ ,. . drawing showing the example of setting out o. the fleld in an 
operation gestalt which can be photoed. 

jpj,^ ,t is drawing showing .he structure of the camera-oontroi iimit list in 

an operation gestalt. 

^5^^ ,t is drawing shewing the system conflguration o, .he modiflcation in 

an operation gestalt. 

^^^^^ ,. is drawing showing .he camera .is. in .he svs.em of »il • 



